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Abstract. This paper studies a one-sector optimal growth model with i.i.d. produc¬ 
tivity shocks that are allowed to be unbounded. The utility function is assumed to be 
non-negative and unbounded from above. The novel feature in our framewo rk is that the 
agent has risk sensitive preferences in sense of lHansen and Sargent fjl995l) . Under mild 
assumptions imposed on the productivity and utility functions we prove that the maxi¬ 
mal discounted non-expected utility in the inhnite time horizon satisfies the optimality 
equation and the agent possesses a stationary optimal policy. A new point used in our 
analysis is an inequality for the so-called associated random variables. We also establish 
the Euler equation that incorporates the solution to the optimality equation. 


Keywords, stochastic growth model, entropic risk measure, unbounded utility, un¬ 
bounded shocks. 


1. Introduction 


This paper deals with one-sector stochastic optimal growth model with possibly un¬ 
bounded shocks and non-negative utilities that are allowed to be unbounded from above . 


Bovd ( 

1990) 

: Duran 

(2000); 

Le Van and Morhaim 

and Duran ( 

2003 

); J 

askiewicz and Nowak 

(2011b) 


fl2002r) for the determin istic problems. 


problems. Most of the aforem e ntione d works apply the weighted supremum norm ap¬ 
proach introduced bv IWesselsI (119771). The other group of paper s makes use of the 
idea presented by Rincon-Zapatero and Rodriguez-Palmero I ( 20031) within determinis¬ 
tic framework. Their method rests upon a local contraction and utilises one-sided ma- 
jorant functions . The extensions of t h ese res u lts to stochastic dynamic programmin g 
are reported in Jaskiewicz and Nowak (2011a); Martins-da-Rocha and Vailakis I ( 2010 ): 


Matkowski and Nowak (120111) . 


The novelty in our model relies on the fact that the agent has risk sensitive preferences 
of the form 


Vt = u{at) - - lnUi[-7Ut+i], 
7 


( 1 ) 


where 7 > 0 is a risk sensitive coefficient, (3 G [0,1) is a time discount factor, at is 
consumption at time t, u is a felicity function and V) is the lifetime utility from period t 
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onward. Here, Et stands for the expectation operator with respect to period t information. 
The parameter 7 affects con sumer’s attitnde towa r ds ris k in future utility. The form of 
preferences in ([1]) is due to Hansen and Sargent f 19951) . who used them to deal with 


a linear quadratic Gaussian control model. The preferences dehned in ([T]) has several 
advantages. First of all, they are not time-additive in future utility. Time-additivity, 
however, requires an agent to be risk neutral in future utility. Risk sensitive preferences, 
on the other hand, allow the agent to be risk averse in future utility in addition to being 
risk averse in future consumption. This fact results in partial separation between risk 
aversion and elasticity of intertemporal substitution^ Moreover, as argued by ? risk 
sensitive preferences are also attractive, because they can be used to model preferences 
for robustness. It is worth emphasising that risk sensitive preferences of form ([1]) have 
found several applications , for instance, in the problems deali ng with Pareto optim al 


allocations (see [AndersonJ (120051) 1 or small noise expansions fsee lAnderson et ahl (120121) 1. 


Our main results are two-fold. First we establish the optimality equation for the non- 
expected utility in the inhnite time horizon, when the agent has risk sensitive preferences 
([T]). The proof as in the standard expec ted utility case is based on the Banach con¬ 


traction principle, see IStokev et ah (119891 1. However, in oder to show that the dynamic 


programming operator maps a space of certain functions into itself, we have to conhne our 
consideration to concave, non-decreasing and non-negative functions that are bounded in 
the weighted supremum norm. A novel feature in this analysis is an application of some 
inequality for the so-called associated random variables. This inequality also plays a cru¬ 
cial role in proving that the a hxed point of dynamic programming operator is indeed the 
value function. Moreover, it naturally hts into our model, in which the production and 
utility functions satisfy some mild conditions such as mono t onicit y and concavity. Here, 
we would like to emphasise that similarly as in iKamihigashi (120071) . we do not assume the 
Inada conditions for the production function at zero and inhnity. Secondly, we establish 
the Euler equation assuming that the production and utility functions are continuously 
differentiable. As an by-product, we obtain the existence of a distribution function for the 
income process governed by the o p timal policy. This result owes much previous works by 


Nishimura and Stachurski (120051 1. IStachurski (120091) that link the Euler equation with 


the Foster- Lyapunov functions. 

The paper is organised as follows. Section 2 describes the model, risk sensitive prefer¬ 
ences of the agent and provides essential assumptions. In Section 3, we use the dynamic 
programming approach to show that the agent has an optimal stationary policy and the 
lifetime utility is a solution to the optimality (Bellman) equation. Section 4 establishes 
the Euler equation. Section 5 makes use of the Euler equation to dehne a Foster-Lyapunov 
function, which is applied to the proof of stability of the optimal program. Finally, Section 
6 gives two examples that illustrate our theory. 


Consult Epstein and Zin ( 19891) . Tallarini ( 2000 , Miao (2014 ) fo r more discussion on this topic. 


The reader is also referred to Chapters 1 and 3 in I Becker and Bovd (ll997l) that constitute a strong 


motivation for the study of non-time-additive objective functions. 
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2. The Model 


This section contains a formnlation of the stochastic optimal gr owth model with the 


payoff criterion that in a particnlar case rednces to the one stndied bv iBrock and Mirman 
(119721) . The symbols R+ and M++ denote the non-negative and positive real nnmbers, 


respectively. Let N be the set of positive integers. The process evolves as follows. At time 
f G N the agent has an income Xt, which is divided between consnmption at and investment 
(saving) yt- From consnmption at the agent receives utility u{at) (which is independent of 
Xt). Investment is used for production with input yt yielding output Xt+i = f{yt, ^t), where 
(^t)iGN is a sequence of i.i.d. shocks with distribution z/ G Pr(M_|_) and / : M+ x R+ i—)■ R+ 
is a production function. It is assumed that xi G R+ is non-random. 

We make the following assumptions. 


(Ul) The function u : R+ i—)■ R+ is continuous at zero, strictly concave, increasing and 

m(0) = 0. 

(U2) There exist a constant d > 0 and a continuous non-decreasing function w : R+ i—)■ 
[1, cxd) such that 

u{x) < dw{x), for all x G R+ 

and ([2|) holds. 

(FI) For every z > 0 the function f{-,z) : R+ i—)■ R+ is continuous, concave, non¬ 
decreasing and for every y > 0 the function f{y, •) : R_|_ i—)■ R_|_ is Borel measurable. 
(F2) There exists a constant a G (0,1//3) such that 


sup / w{f{y, z))h'(dz) < aw{x), for all x G R+. 

y&[0,x\ 


( 2 ) 


Put 

D := {(a;,?/) : x G R+, ?/ G [0,x]}. 
For any f G N, by Ht we denote the set of all sequences 


ht = 


Xi, 

(xi,2/i,X2, ... ,Xt), 


for f = 1, 
for f > 2, 


where {xk,yk) ^ D for all k G R+. Hence, Ht is the set of all feasible histories of the 
income-investment process up to date t. An investment policy tt is a sequence {'n't)teN, 
where tt* is a measurable mapping which associates any admissible history ht with an 
action yt G [0,Xi]. By H we denote the set of all investment policies. We restrict our 
attention to non-randomised policies, which are enough to study the disco unted optimal 
growt h models. A formal dehnition of a general policy can be found in IStokev et ah 
(119891) . Let $ be the set of all Borel measurable functions such that 0(x) G [0,x] for 
every x G R+. A stationary (investment) policy is a constant sequence vr with Tit = 4> for 
every f G N. We shall identify a stationary policy with the member of the sequence, i.e., 
with the mapping 0. By <F we also denote the set of all stationary investment policies. 
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In this paper, we shall consider the non-expected utility of the agent in the inhnite time 
horizon derived with the aid of the so-called entropic risk measnre. In order to dehne this 
measnre let ns denote by (hi, P) a probability space and let X be a non-negative random 
payoff defined on (r2,X, P). The entropic risk measnre of X is 


p(X) = --ln [ 

7 Jq 


where 7 > 0 is the risk sensitive coefficient. Let X, Y be non-negative random variables 
on (Q,P,P). The fo l lowin g properties of p are important in the analysis (see p. 184 in 


Follmer and Schied (120041) b 


(PI) monotonicity, i.e., ii X <Y p{X) < p{Y) 

(P2) concavity, i.e., p{\X + (1 — A)F) > \p{X) -l- (1 — A)p(F) for any A G [0,1]. 

However, this measnre is not positive homogeneons, i.e., p{aX) 7^ ap{X) for a G M++, 
which does not make onr analysis straightforward (see the proofs of Lemma 4 and Theorem 
1). Here, we wish only to mention that making nse of the Taylor expansions for the 
exponential and logarithmic fnnctions, we can approximate p{X) as follows 

p{X) ^EX - ^VarX, 

if 7 > 0 is snfficiently close to 0. Therefore, if X is a random payoff, then the agent 
who evalnates his expected payoff with the aid of the entropic risk measnre, thinks not 
only of the expected valne EX of the random payoff X, b nt also of its varianc e . F ar¬ 


ther comments on the entr opic risk measnre can be fonnd in iBanerle and Rieder (1201111 : 


Follmer and Schied (l2004l ) and references cited therein. 


Assnme that fc G N. We say that a fnnction G Byj{H}f), if Vk ■ ^ 


is Borel 


measurable and there exists a constant dy^ > 0 such that Vk{hk) < dy^w{xk) for every 
hk G Hk- Here, w is a function used in (U2) and (F2). Let vr = {7ik)km G H be any policy. 
For Vk+i G By,{Hk+i) and given hk G Hk we put 
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Observe that by Jensen’s inequality and (F2) we have 

0 < PTTkMi'^k+i) < / Vk+i{hk,7rk{hk),f{T^k{hk),z))u{dz) 


( 3 ) 


( 4 ) 




w{f{7ik{hk),z))u{dz) 


< sup / w{f{y,z))iy{dz) < dy^^^.^aw{xk) 

ye[o,xk] Jr+ 

for any hk G Hk and fc G N. Furthermore, we define the operator as follows 
L-Kk^k+lihk) ■ u{Xk T^kihkf) T fd P’Kf.,hk^'^k+l) i 
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where [3 G (0,1) is a subjective discount factor. By property (PI), it follows that is 
monotone, i.e., L^^^Vk+i{hk) < L^i^Vk+i{hk) for hk G Hk and Vk+i < Vk+i- Moreover, by 
dl]), (U2) and (F2) we get that 


0 < L^^Vk+i{hk) < {d + a/3d^^^^)w{xk) 


(5) 


for every hk G Hk with A; G M. 


We follow the approach of lHansen and Sargent 
the consumer recursively. For any initial income Xi = x and T 
total discounted utility 


(119951) and model the preferences of 
G N we define T-stage 


Jt{x, tt) := o ... o L^^)O(x) 


( 6 ) 


where 0 is a function such that 0(hk) = 0 for every hk G Hk and A; G N. For instance, if 
T = 2 definition ([2]) is read as follows 


J2{x,7i) = (L,ri oL^^)0{x) = L^-^{L^^0){x) 

= u{x - 7ri(x)) - - In / 

7 Jr+ 

= u{x - TTi{x)) - - In / 

7 Jm.+ 


Observe that from (Ul) and (PI), it follows that the sequence (Jr(a;, 7r))TeN is non¬ 
decreasing and bounded from below by 0 for every x G M+ and vr G If. Moreover, 

Jt{x, tt) < fQj. g TT G n, T G N. 

1 — ap 

Indeed, note first that by (U2) we have 

L^^0{hT) = u{xt - vrT(hr)) < u{xt) < dw{xT) < hr G Ht- (7) 

1 — ap 

Now making use of ([5]) with A; := T — 1, VT^hx) ■= dw{xT)/{l — a(3), ([7]) and monotonicity 
of the operator 'w® obtain 


Ltzt-I (L.,0)(hr-i) < 


dw 


(hx-i) < dw{xT-i) + afd 


dw{xT-i) dw{xT-i) 

1 — a/3 1 — a/3 


dw 


1 — a/3 

Continuing this procedure, we finally infer that 

Jt{x, tt) = (L^i o . . . o L^^)0{x) < (L^i o . . . o L^rr-a) 

, , , a/3dw(x) dw(x) 

By the above discussion liniT-^-oo Jt{x, tt) exists for every x G M+ and vr G 11. 


1 — a/3 


{x) < 


5 













The problem statement. For an initial income x G M+ and policy tt G 11 we define the 
non-expected disconnted ntility in the infinite time horizon as follows 


J{x,7i) := lim Jt{x,7i). 

T—>-oo 


( 8 ) 


The aim of the agent is to find an optimal valne (the so-called value function) of the 
non-expected discounted utility in the infinite time horizon and a policy vr* G If for which 

J{x, n*) = sup J{x, tt), for all x G M+. 

ttGII 

Remark 1. When the risk sensitive coefficient 7 —)■ 0+, then the non-expected utility 
i n (IHl) tends to the von Ne umann-Morgenstern expected utility that was hrst studied by 


Brock and Mirman (119721 ) for a stochastic optimal growth model. The greater 7 > 0 the 


more risk averse is the agent. 

The entropic risk measure, which we used in our framework (see ([3]) is also known 
as the exponential certainty equivalent. It can be used to study the models with robust 


entropy as a penaltv function, see 

Follmer and Schied 

(20041 or Jaskiewicz and Nowak 

(2011bll. Moreover, as noted bv 

Hansen and Sareent 

(19951 the specihcation of such 


recursion provides a bridge between risk sensitive contr ol theory (see I Whittle 


and a more general recursive utility specihcation used by Epstein and Zin ( 19891) 



3. The Bellman Equation 

In order to solve the aforementioned problem we shall use the dynamic programming 
approach. We start from the definition of a class of functions among which we look for a 
solution to the optimality equation. 

For a Borel measurable function v : M_|_ e->■ M define its ta-norm as follows 

|n(a:)| 

||n||^ := sup — 

WyXj 

Let be the set of all Borel measurable functions v : 1 —)■ R with the hnite w-norm. 

Then, {By,, H-Hio) is a Banach space (see Proposition 7.2.1 in IHernandez-Lerma and Lasserre 
(1999)). Dehne 


B -.= {v E By, : V is continous, concave, non-decreasing, non-negative} . 

Note that {B, || • ||.u,) is a complete metric space as a closed subset of the Banach space 
( By, , II • 111/)). 

Now we are ready to state our hrst result. 


^The reader is referred to Chapter 20 in iMiao (|2014l) . where a detailed discussion, further references 
on this topic are provided. 
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Theorem 1. Assume (U1)-(U2) and (F1)-(F2). Then, the following holds. 

(a) There exist unique funetions V E B and i* G $ such that 

V{x) = sup (u{x — y) — — \n f (9) 

j/€[0,x] \ 1 Jr_I_ / 

= u{x — i*(x)) — — \n [ (10) 

7 Jr+ 

for all X E M+. Moreover, V is strictly concave. 

(h) The functions x i—)■ i*{x) and x i—)■ c*{x) := x — i*{x) are continuous and non¬ 
decreasing. 

(c) V{x) = sup^gn= J{x,i*) for all x E M+, i.e. there exists an optimal sta¬ 
tionary policy i*. 

Throughout this section we assume that (U1)-(U2) and (F1)-(F2) are satished. We 
start with a result that we shall use in many places. 

Lemma 1. Let v E B. Then, the function 

y ^ v{y) := —In [ 

7 Jr+ 

is continuous, concave, non-decreasing and non-negative. 

Proof. By (FI) we have 0 < f{0,z) and 0 < u(0) < v{f{0,z)) for any 2 : e M+. Hence, 
(PI) yields that 0 < u. Furthermore, by (FI) the function v{f{-,z)) is non-decreasing for 
every G M+. Thus, by (PI) the function v is also non-decreasing. Similarly, making use 
again of (FI) we hnd that u(/(-, z)) is continuous for every 2 ; G M+. Hence, the dominated 
convergence theorem implies that v is continuous. Finally, we show the concavity of v. 
Let y = \y' + (1 — \)y'' , where A G (0,1). By (FI) it follows that 

f{y, z) > \f{y', ^) + (1 - \)f{y", z), z E M+, 

and by the fact that v is non-decreasing and concave we obtain 

v{f{y, z)) > v{Xf{y', z) + {1 - A)/(/, z)) > Xv{f{y', z) + {1 - X)v{f{y", z)), z E M+. 
Now, properties (PI) and (P2) imply that 

v(y) > -- In [ > Xv{y') -f (1 - A)F(/), (11) 

7 Jr+ 

which hnishes the proof. □ 
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Lemma 2. Assume that i G $ is a non-decreasing function such that x x — i{x) is 
also non-decreasing. Then, for any T G M the function x i—)■ Jt^xA) is non-decreasing 
and continuous. 

Proof. Note that i is Lipschitz continuous with constant less than or equal to 1. We 
proceed by induction. For T = 1 the assertion is true by (Ul). Assume that it holds for 
some T G N. Then, 

JT+i{x,i) = u{x — i{x)) — —\n [ (12) 

7 2r+ 

Now the conclusion follows as in Lemma [U with assumption (Ul). □ 

Lemma 3. Assume that gi are non-decreasing and non-negative for i = 1, 2. Then, it 
follows that 

--In [ < 

7 Jm.+ 

--In / _ iin / 

7 Jr+ 7 Jr+ 

Proof. The inequality follows from Proposition [1] in the Appendix. It suffices to define 
X := f{y,^), where ^s a random variable of the distribution z/ and put h := 
g := e~'^^^. □ 

For any n G S, we dehne the operator L as follows 

Lv{x) := sup (u{x — y) — —\n f (13) 

ye[0,x] \ 7 / 


for all X G M+. 

Lemma 4. The operator L maps B into itself and is contractive. 

Proof. Let v & B. First note that by (U2) and (F2), we obtain 

\\Lv\\u, <d + a/3||n||^„, 

and by (Ul) and Lemma [T] we have that Lv > 0 (see also (jS])). Moreover, by (Ul) and 
Lemma [T] the functio n (x, y ) i—)■ u{x — y) + (3v{y) is continuous on D. Thus, the maximum 
theorem (see Beree f 1963h ) implies that Lv is continuous. Next, we observe that for 
x' < x”, we have 

Lv{x') < sup {u{x'' — y) + I3v{y)) < Lv{x"). 

ye[0,x'] 

We now show that Lv is concave (see also Sec. 2.4.4 in iBauerle and Rieder fj201ll) ). 
Let A G (0,1), x',x'' G M+ and x := \x' + (1 — X)x''. By y' G [0,x'] and y" G [0,a;"] 












we denote the points that attain the maximum in ffT3l) at x' and x", respectively. Then, 
y := Xy' + (1 — X)y'' G [0, x]. Hence, we get 

Lv{x) > u{x — y) — — \n [ (14) 

7 JR+ 


Moreover, by (Ul) we obtain 

u{x — y) > Xu{x' — y') + (1 — X)u{x' — y'). (15) 

Now combining fflTl) with flT^ and flTTl) we finally obtain 


Lv{x) > XLv{x') + (1 — X)Lv{x''). 


It only remains to prove that L is contractive. Assume that Vi,V 2 G B. Then, 


ly(dz) + — In / e 

7 J 


^-'yv2{f{y,z)) 


Lvi{x) — Lv 2 {x) < sup 1^—— In f e 
ye[o,x] V 7 

/? sup (--In / + -ln / ) 

j/e[o,x] V 7 Jr+ 7 Jr+ / 


< 


< fd sup I-In / 

y€[0,x\ V 7 7r+ 

1 


:,-'l\\vi-V2\\-ww{f{y,z)) 


v{dz) 


^-'yv2if{y,z)) 


u{dz) 


In 


^--/V2if{y,z)) 


7 




= (d sup-In 

ye[0,x] 7 


^-^\\vi-V2\Uw{f{y,z)) 


u{dz) 


< (d sup / \\Vi —V 2 \\ww{f{y^z))v{dz) (by Jensen’s inequality) 


y&[0,x] JR_|_ 

< ald\\vi - V2\\ww{x) (by (F2)). 

The second inequality follows from property (PI) and the third one from Lemma [3] (^^i = 
11^1 — V2\\wW, 92 = ^ 2 ) and the fact that w and V2 are non-decreasing. By changing the 
roles of Vi with V 2 we obtain 


||Lni - Lv 2 \\w < a(d\\vi - V 2 \\w, 


where aid <1. □ 

Proof of Theorem [H Part (a) follows from Lemma 0] and the Banach fixed point 
theorem applied to the operator L. Hence, ([2]) holds. In addition, note that V is strictly 
concave, because of strict inequality in (IT^ . 

Since, by Lemma [Hand (Ul) the function 

y ^ u{x - y) - ^\n [ 

7 Jr+ 
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is continuous and strictly concave on [0,x] for x G M+, it follows that there exists a 
unique point y* G [0,a;] that re alises the max imum on the right-hand side of ([9]). Hence, 


see 


by the maximum theorem 
i* G attaining the m aximum in 


Berge 


m 


fjl963fB there exists a unique continuous function 
In additi on, strict conca vity of u and Lemma 3.2 


Balbus et ah I (120151) (see also Theorem 6.3 in iTopkis (119781) 1 imply that the function 


i* is non-decreasing. Furthermore, observe that (jl]) can be re-formulated as follows 


V{x)= sup (u{a)--III [ 

a€[0,3;] \ 1 


v{dz] 


X G 


Assumption (Ul) and strict concavity of V and Lemma 3.2 in Balbus et ah ( 20151 ) yield 
that the consumption strategy c* G $ is also non-decreasing. Clearly, c*(x) -f i*(x) = x 
for every x G M+. Hence, part (b) holds true. 

Part (c). From ([9]) it follows that 

V(x) > u(x — y) — — In f y G [0, x] 

7 Jr. 


and X G M+. Let tt = {7ik)km G H be any investment policy. Then, for any history 
hk E Hk, k E N, the above display implies that 


V{xk) > L^,V{hk). (16) 

Fix any T G N. Starting from (1161) for k := T and applying (fT 6 l) consecutively for k = 
T — 1,..., 1 we infer that 


V{x)>{L^,o...oL^^)V{x). 

Since H > 0 and is monotone for every tt^, fc G N, we obtain 

V(x) > (L^i o ... o L^^)V(x) > (L^i o ... o L^^)O(x) = Jt(x, tt), (17) 

for any tt G H and x G M+. Letting T —?■ oo in (ITTD . we hnally have V(x) > J(x,7r) for 
any tt G H and x G M+. Hence, 

H(a;) > sup J(x, vr) x G M+. (18) 

ttGIT 

Let i* G $ be as in (fTOj) . For convenience of notation we set Ui*(x) := u(x — i*(x)) and 
for any non-negative function ip G 

Pi*,x(7’) In / Li*(p{x) := Ui*{x) + x G M+. 

7 Jr+ 

Thus, the right hand-side of (ITUD equals 


Li*V{x) = Ui*{x) + /3pi*^^{V), X G M. 
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By iterating the latter equality T — 1 times we get that 

V{x) = l[Pv{x), X e M+, (19) 

where denotes the T-th composition of the operator Lj* with itself. Thus, flT^ . 
property (PI) and Jensen’s inequality together with (F2) (see also (jlj)) yield that 

V{x) = + ^pi*^.{V)){x) < + ^Pi*^.{\\V\\^,w)){x) (20) 

< + a/3\\V\\^w){x) 

= + /3pi*^.{ui* + a^\\V\\^,w)){x) 

for X G M+. Now by putting gi := Ui* = g 2 := a/S||ld||,«w in Lemma [3l we have 

that 

I3pi*,x'{ui* + a(3\\V\\ww) < (3pi*^x'{ui*) + (3pi*^x\a(3\\V\\ww) (21) 

< I3pi*,x'{ui*) + {al3f\\V\\yjw{x'), x'e M+, 

where the second inequality is due to Jensen’s inequality and assumption (F2) (see also 
(jl])). Hence, inequalities fl20l) and combined together get 

V{x) < + I3pi*^.{ui*) + {al3f\\V\\^w){x) (22) 

= + f3pi*^.{ui* + /3pi*^.{ui*) + {al3f\\V\\yjw)){x). 

We repeat the procedure. From Lemma [2] the function 

X HG- J 2 {x,i*) = Ui*{x) + (3pi*^x{Ui*) 

is non-decreasing. Hence, making use again of Lemma[3] ( 5^1 := T 2 (-,P),fi '2 := {.(xl3)‘^\\V\\ww), 
Jensen’s inequality and (F2) we get 

I3pi*,x'{ui* + l3pi*Xui*) + {a(3f\\V\\ww) (23) 

= (ipi*,x'{J 2 {-,i*) + {a(3f\\V\\y,w) < (ipi*,x'{J 2 {-,i*)) + l3pi*,x'{{oil3f\\V\\yjw) 

< (ipi*,x'{J 2 {-,i*)) + {al3f\\V\\y,w{x'), x' e M+. 

By combining fl22|) and (|2^ we obtain that 

V{x) < + l3pi*XJ2{-,i*)) + {al3f\\V\\ww){x) 

= + l3pi*XJz{-,i*) + («/3)^||^IUw^))(2:)- 

Repeating this procedure, i.e., making use of Lemma [3] for the functions gi = Jk{-,i*) 
(by Lemma[2]it is non-decreasing) and g 2 := (a/3)*’||H||^w for fc = 3,..., T — 1 we hnally 
deduce 

V{x) < JT{x,i*) + {af3)'^\\V\\y,w{x), x e M+. (24) 

Thus, letting T ^ cxd in fl241) it follows that 

V{x)<J{x,i*) X e M+. 

Now, ffTSj) and fl25l) combined together yield part (c). 
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(25) 

□ 


4. The Euler Equation 

This section is devoted to establish the Euler equation. Therefore, we shall need 
additional conditions that guarantee differentiability of functions describing the model. 


(U3) The function u : M_|_ i—)■ M+ is continuously differentiable on M+_|_. 

(U4) M+(0) = oo. 

(F3) The function f{-,z) : M+ M+ is continuously differentiable on M++. 
(F4) /(O, z) = 0 for all z >0. 

(F5) There is an investment y > 0 such that 


f\y,z)v{dz) > 0, 


where f{y, z) := I 

Assumption (F5) together with (FI) rules out the trivial case that f{y, z) = 0 z/-a.s. 
for every y G M+. 


Theorem 2. Assume (U1)-(U4) and (F1)-(F5). Then, we have the following. 

(a) For any x G M++ the Euler equation holds 

^ z)))f'{i* (x 
/r+ a-zV^Fd*{x),A)ii[dz) 

where V is the function obtained in TheoremUl 

(b) The functions x i-G- i*{x) and x i—)■ c*{x) are increasing. 


),z)u{dz) 


u'{c*{x)) = fd 




(26) 


Remark 2. The Euler equation for the agent with risk sensitive preferences incorporates, 
in contrast to the standard expected utility case, the value function V. When 7 = 0, then 
equation fl26D becomes the wel l -know n Euler equation for th e model with the expected 


utility, see iBrock and Mirman I (1197211 or iKamihigashi fj2007|l . 


Let us define 

V(y):=--\n[ (27) 

7 Jr+ 

In the subsequent lemmas we shall assume that conditions (U1)-(U4) and (F1)-(F5) hold 
true. 


^Note that by Theorem 7.4 in Stokev et al. ( 1989h it follows that the function z f'{y,z) is Borel 


measurable. 
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Lemma 5. The function V defined in is concave, continuous and non-decreasing. 
Moreover, 

y;( 0 ) = cx). (28) 

Proof. The first part follows from Lemma [H Take any sequence —)■ O’*" as n —)■ oo. 

By (F4) and the fact that m( 0) = 0 we get that P(0) = 0 and P(0) = 0. Hence, 


V{yn) - ^( 0 ) 


In / e > —In 

Js.+ 7 


Vn 'TUn 

From the chain rule, we have for any ^ G M+ that 

M(/( 2 /n, z)) u{f{yn, z)) - m(0 ) f{yn, z) - /(O, z) 


e ' v{dz). 


(29) 


Letting n —)■ oo in 


yn f{yn,z) - f{0,z) 

, we obtain that 

u{f{yn,z)) 


yn 


lim 

n—^oo 


yn 


= u'Jf{0,z))f'{0,z). 


(30) 


(31) 


Note that the convergence in fl3TD is monotonic, since u and f{-,z) are concave and f{-,z) 
is non-decreasing for z G M+. By the monotone convergence theorem, fl2^ and flTID we 
finally get 

K(0)>-iln [ 

7 Jr+ 

Assumption (F5) together with (FI) yield that f!^{0,z) > 0. Thus, by (U4) the assertion 
follows. □ 


Lemma 6. Let i* be defined in m. Then, i*{x) G (0,a;) for any x G 




Proof. The assertion that i*{x) > 0 follows fr om assumption (U4), whereas 
i*{x) < X. The reader is referred to Lemma 5 in iKamihigashi (120071) . 


yields 

□ 


Lemma 7. The function V is continuously differentiable on M++ and V'{x) = u'{c*{x)), 
for X G M++. 

Proof. The way of showing the equality pr oceeds along the s ame lines as the proofs of 
Proposition 12.1.18 and Corollary 12.1.19 in Stachurski (2009). □ 

Proof of Theorem [2l First we show part (a). In view of Lemma [7] and ([9]), it suffices 
to show that V is differentiable on M_|_+ and fiV'{y) ai y = i*{x) equals to the right-hand 
side of (1261) . Since V is concave by Lemma 0 we know that the right-hand side and the 
left-hand side derivatives exist. Let y G M++ be arbitrary and h > 0. Set 


F{y,z) := 


z-iVifiy,z)) 


J e-zV(.fiyF)u{dz) 


> 0 
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and note that 

/ F{y,z)i'{dz) = l for any ?/G M++. 

J 9 .+ 

Then, by Lemma [7] and (F4) 

V{y + h)-V{y) 


h 


1 




< 


V{f[y + h,z))-vu\y,z)) 
h 


F{y,z)u{dz) 


< 


f y{fjy + h, z)) - V{f{y, z)) f{y + h, z) - f{y, z] 
L+ f{y + h,z)- f{y,z) h 

[ y'ifiy, z))f{y, z)F{y, z)v{dz) =: G{y), 


F{y,z)iz{dz) 


where the hrst ineqnality is dne to Jensen’s ineqnality and the second one follows from 
the fact that V and /(•, 2 ;) for 2 ; G M+ are concave and non-decreasing. Thus, for y G M++ 


Kiv) < Giy)- 

Let us now consider the left-hand side derivative of V, i.e.. 


(32) 


V(y -h)- V{y) 
-h 


> 


1 / k+s zvifiy 
^ 4 ^ e-zVifG^)) 

r V{f(y-h,z))-V{f{y,z)) 
./». — h 


F{y,z)iz{dz) 


> 


yifjy - K z)) - yifjy, z)) f{y -h,z)- f{y, z) 
f{y - h,z) - f{y,z) -h 

y’{f{y,z))f{y,z)F{y,zMdz) = G{y). 


F{y,z)u{dz) 


Hence, for y G M++ 

r{y) > Giy). (33) 

Observe that G is continuous. This is due to Lemma [7l (FI), (F4) and the dominated 
convergence theorem. Since V is concave and fl3^ and fl3^ hold, then for h > 0 we obtain 
that 


G{y + h)<r{y + h)< Vl{y) < G{y) < V'_{y) < %{y - h) < G{y - h). (34) 

Now letting h —)• 0’*' in (|3T|l . it follows that V is continuously differentiable on M++. 
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In order to prove (b) suppose that x' < x". If x' = 0, then by Lemma [6] we have 
= 0 < i*{x"^ and c*(a;') = 0 < c*(a;") = x” — i*{x''^. Hence, let x' > 0 and 
= z*(x"). Then, by Euler equation fl26|) . we obtain m'(x' — i*(x')) = m'(x" — -i*(x')). 
But the equality cannot hold, since u is strictly concave. Similarly, if c*{x') = c*(x"), 
then by Lemma [7] we must have V\x') = u\c*{x')) = u'{c*{x'')) = V\x''). However, this 
equality contradicts the strict concavity of V. □ 


5. Stationary Distributions 


In this section, we shall consider dynamics of the growth model when the agent follows 
the optimal policy i* G <h. Our aim is to provide a set of assumptions under which 
the system is globally stable and the resulting stationary distribution is non-trivial in 
the sense that it is not concentrated on zero. We wish to fol low the appro a ch stu died 


m 


Nishimu ra and Stachurski (120051) and further developed by lKa.mihiga.shi (120071) and 


Stachurski (l2009h . It combines the Euler equation (see (I26|B with the Foster-Lyapunov 
theory of Markov chains. 

More precisely, we deal with the process 

xt+i = f(i*(xt),^t), (&) is i.i.d. sequence, where ~ i/ G Pr(R+) (35) 

and / : M+ xM+ i-G- M+ is continuous. Clearly, (xt)*^^ is a Markov process. Assuming that 
f{y, z) > 0 for every y e M++ and utilising the fact that i*{x) G (0,x) for x > 0, we may 
conhn e ourselves to the study of the income process on R++ (see p. 303 in IStachurski 
(120091) L We show the existence of at least one stationary non-trivial distribution. Ac¬ 
cording to Proposition [2] in the Appendix, we have to find a function W : R++ R_,_ 

satisfying properties (a) and (b). Since we wish to avoid repeating all the details contained 
in the aforementioned papers, we focus only on an element in the proof that makes use 
of the Euler equation. This is because, the Euler equation in our framework is different 
than the one obtained for the expected utility case. Therefore, we formulate o nly cr ucial 


conditions in the most simple way. The reader is referred to lKa.mihiga.shi (120071) and 


Stachurski (120091) . where a detailed discussion and more general conditions are provided 
implying the ones given below. 


(Dl) It is satisfied that 


lim 

y^0+ , 


(D2) There exist A 2 G (0,1) and ^2 > 0 such that 


-v{dz) < 1. 


f{y,z)v{dz) <X 2 y + K 2 , yE 


Here, we would like to mention that Assumption (Dl) prevents probability mass from 
escaping to inhnity, whereas the role of (D2) is to prevent probability mass from escaping 
to zero. 
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Lemma 8. Assume (Dl). Then, for W\{x) := ^Ju'{c*{x))e~'^^^A^ x G M++, there exist 
Ai G (0,1) and Ki > 0 such that 


Wi{f{i*{x),z))v{dz) < \iWi{x) + Ki, X G 


H+- 


Proof. First note that by the Cauchy-Schwarz inequality, it follows that 


A^\{f{i*{x),z))n{dz) = 


PfjT jx), z) e V(hz) 

/3f'{i*{x),z) Jg 


^{dz) 


< 


X 


u[c [j[z [X),z)))e e-^^(TiAA,A)u{dz) ^ ^ 


X 


u{dz) 


1 + ^f'ii*{x),z) 

Furthermore, applying fl26l) to fl36|l we obtain that 


X G 


^++- 


(36) 


Wi{f{i*{x),z))iy{dz) < ^,/u'{c*{x)) 

< \/u'{c*{x)) 


ni^dz) 


I3f'{i*{x),z) 

u{dz) 1 ^ 
Pf'{x,z)\ 




u{dz) 


(37) 


where the second inequality is due to the fact that P > 0 and (FI) (/'(•, 2 ;) is non¬ 
increasing for 2 ; G M+). From assumption (Dl), it follows that there exists 5 > 0 such 
that 

- - i 

2 


Ai := 


i>{dz) 


< 1 . 


Then, for x G (0,5) we have that e consequently, by fimi 

1 

^{dz) 


Wi{f{i*{x), z))i'{dz) < WM'(c*(x))e“'^^P)e'’'/^^*''^^ 


/9/'(^, ^) 


< AihFi(x). 


(38) 


For X > 5 we have 

[ a\(f(f(x),z)Hdz)< [ ( 39 ) 

J M-j- J M.-|_ 

Inequalities fl55]l and (15^ combined together yield the conclusion. □ 
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From Lemma [8] and (D2) we deduce that the function 


W{x) = Wi{x) + X, 


X G 


^++ 


satishes point (b) in Proposition [2] with A := max{Ai,A 2 } and k := Ki + K 2 . Clearly, 
from (U4) it follows that condition (a) is also satished. Hence, there exists a non-trivial 
distribution for the Markov process in fl3^ . 

The problem of the un iqueness of a statio n ary distribution, i.e., globa l stab ility, 


( 2007 ). [Nishimura and Stachurski ( 2005 1 and 


has been re c ently studied in iKamihigashi 

Stachurski I (2009). Therefore, we do not give here all these assumptions and refer the 


reader to the above-mentioned works. Further results on invariant distributions are also 


m 


widely reported in iMeyn and Tweedie (1200911. i Bliattac harva and Maiumdar (120071) and 
the recent papers of Ka.mihigashi and Stachurski r(l2014 1. Zhang ( 2007 1. 


Remark 3. If the income process evolves on the compact space [0,s], then the assump¬ 
tions (U2) and (F2) are satished with w = 1. Consequently, the results in Sections 3 and 4 
are satished, in particular, the optimal investment policy is non-deacreasing. In this case, 
the existence of a non-trivial invariant distr ibution follows fro m the Krylov-Bogolubov 
theorem, see for instance. Theorem 11.2.5 in Stachurski ( 2009ll . 


6. Examples 

Below we provide two examples of utility and production functions that meet our 
assumptions used in Sections 3-4. 

Example 1. A model with multiplicative shocks. Assume that the process evolves ac¬ 
cording to diherence equation 


Xt+i = Vtit, t G N, 


where 9 G (0,1). Suppose that z := zi'{dz) is hnite and let u{a) = a®" with a G (0,1). 
Clearly, (Ul) and (FI) are satished. Assumption (U2) holds for w{x) = {r + xY, where 
r > 1 is a constant sufficiently large so that 



Then, calculations on p. 263 in Jaskiewicz and Nowak I (2011 bll show that (F2) is also 


satished with a := (1 -|- 


. We also note that (U3)-(U4) and (F3)-(F5) hold true. 

For this model, conditions (Dl) and (D2) are met as well. Clearly, the hniteness of 
Jjj l/zi'{dz) implies (Dl). Dehne now 




max{z, zi-e (1 — 6*)}, Ai := 0. 
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Then, for y < 1 we have 


zv{dz) = y^z < z < By + ki. 


Set l{y) \= By — zy^ + ki for |/ > 0. This function attains minimum at 


Hence, 


for all y G 


1 /min = Zy^-0 and > 0 . 

/ f{y,z)i'{dz) = zy^ <\iy + 


Example 2. A model with additive shocks. Let the evolution of the process be described 
by the equation 


Xt+l 


VVt + Ct, if Vt > 0, 
0 , if yt = 0 , 


where r/ > 0 denotes a constant rate of growth. Obviously, (FI), (F3)-(F5) holds. Let 
the utility u be defined as in Example [TJ Then, (U2) holds for w{x) = (x + rY with any 
r > 1. Now, we prove assumption (F2). Namely, by the Jensen inequality it follows that 


sup / {lyy + zYi^dz) < {rjx + z + rY. 

ye[0,x] J9.+ 


Thus, 


{rjx + z + rY 
sup -- 

a;GR_|_ WyXj 


{s{x)Y, 


where s(x) 


rjx + z r 
X + r 


X G M+. 


We have 


lim s(x) = 1 H—, 
x^o+ r 


lim s{x) = rj. 

X^ + OO 


If ?7 > 1, then from the calculations in iJaskiewicz and Nowak I (1201 Ibl) on p. 264, it 
follows that for r > max{l, condition (F2) holds for all [3 G (0,1) for which fdrj^ < 1 
(here a := rj'^). If, on the other hand, rj < 1, then (F2) is satisfied for each /3 G (0,1). 
Namely, for the given discount factor it is enough to take sufficiently large r > 1 such 
that (1 + f)'"/? < 1 . Obviously, «:=(! + f )<". 

In this case, assumption (Dl) is not met. However, the existence of an invariant dis¬ 
tribution can be proved under some e xtra requirements w it h the help of other techniqu es, 
see for instance, p. 207 and p. 259 in IStachurski (120091 ) or lMeyn and Tweedie (120091 ). 
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7. Appendix 


The following result can be found in iDevrove et al. (1l996l) (Theorem A. 19). 


Proposition 1. Let X be a real-valued random variable defined on {Q,iF,P) and let h 
and g be non-increasing real-valued functions. Then, 

E{hiX)g{X)} > E{hiX)}E{g{X)}, 


provided that all expectations exist and are finite. 


For th e proof of the next result the reader is referred to Ka.mihiga.shi (200^ (L 


3.1) or to Stachnrski (20^ ( Corollary 11.2.10) 


jemma 


Proposition 2. Consider the Markov process defined in (E^. Suppose that there exists 
a function W : M++ e-)- M_,_ such that 

(a) lim W{x) = oo and lim W{x) = oo 

x^oo x->'0+ 

(b) 3k > 0, 3A G [0,1), Vx G M++ f W{f{i*{x),z))h'{dz)<\W{x)-\-n. 

J M.-)_ 

Then, there exists at least one non-trivial stationary distribution on M+. 
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